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Abstract 

Purpose:  This  study  tested  the  effectiveness  of  a  dynamic  educational  and  mentoring  program, 
facilitated  by  unit-level  mentors,  to  introduce,  promote,  and  sustain  an  EBP  culture  among  nurses 
in  a  military  healthcare  setting. 

Background:  The  need  to  identify  gaps  in  practice,  apply  principles  of  evidence-based  practice 
(EBP),  and  advance  scientific  applications  in  the  pursuit  of  quality  nursing  care  is  as  important  to 
military  healthcare  as  it  is  in  the  civilian  sector. 

Description:  The  Advancing  Research  through  Close  Collaboration  Model  guided  the 
intervention  and  study.  Three  instruments  were  used:  The  Organizational  Readiness  for  System- 
wide  Integration  of  Evidence-based  Practice  (ORSIEP);  EBP  Beliefs  (EBPB);  and  EBP 
Implementation  (EBPI)  scales.  The  study  took  place  in  three  military  hospitals  simultaneously 
undergoing  facility  and  staff  integration.  Data  were  collected  from  staff  nurses  in  the  inpatient 
nursing  units  before  and  after  a  facilitated  education  and  mentoring  intervention. 

Outcome:  360  (38%)  nurses  completed  baseline;  and  325  (31%)  completed  follow-up  surveys. 
Scores  improved  on  all  three  measures  following  implementation  of  the  program;  however,  the 
differences  were  statistically  significant  only  for  the  ORSIEP  scale  (70.96  vs.  77.63,  t  =  -3.95 ,p 
<.01).  In  the  paired  individual  pre/post-test  sub-sample  (N=  56),  scores  improved  significantly  on 
all  three  instruments. 

Conclusions:  Despite  typically  high  turnover  rates  of  military  personnel  and  restructuring  of  three 
facilities  during  the  study  period,  the  readiness  for,  beliefs  about,  and  implementation  of  EBP 
improved.  This  study  suggests  that  a  commitment  to  an  EBP  culture  may  diffuse  among 
individuals  in  an  organization,  even  while  experiencing  significant  change.  It  also  demonstrates 
that  a  unit-level  mentored  EBP  program  is  sustainable  despite  changes  in  organizational  structure 
and  workforce  composition. 

Key  Words 

Evidence-based  practice,  culture,  mentor,  organizational  change 
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This  project  was  funded  by  the  TriService  Nursing  Research  Program,  Uniformed  Services 
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conclusions  do  not  necessarily  represent  the  official  position  or  policy  of,  nor  should  any  official 
endorsement  be  inferred  by,  the  TriService  Nursing  Research  Program,  Uniformed  Services 
University  of  the  Health  Sciences,  the  Department  of  Defense,  or  the  US  Government. 
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INTRODUCTION 

The  Institute  of  Medicine’s  (IOM)  report,  To  Err  is  Human:  Building  a  Safer  Health 
System  sharpened  our  nation’s  focus  on  the  need  to  radically  improve  patient  safety  in  current 
healthcare  systems.  Crossing  the  Quality  Chasm  outlined  a  roadmap  for  improving  outcomes  in 
the  American  healthcare  delivery  system.  ’  In  order  to  enhance  patient  safety  and  narrow  the 
research-practice  gap,  the  IOM  set  a  goal  that  by  2020,  90%  of  clinical  decisions  will  be  based  on 
evidence.1  This  goal  challenged  clinicians  to  provide  care  supported  by  accurate,  timely,  and 
current  clinical  infonnation,  reflecting  best  available  evidence  for  practice.  More  recently,  the 
IOM  has  identified  the  urgent  need  for  all  healthcare  stakeholders  to  commit  to  continuous 
learning  and  improvement  in  care  delivery  by  embracing  technology,  collaborating  across  fields 
of  expertise,  and  seeking  the  most  current  evidence.  Evidence-based  practice  (EBP)  is  a  problem¬ 
solving  approach  and  a  foundation  for  excellence  in  practice  that  drives  better  outcomes  for 
nurses  and  other  members  of  the  health  care  team  as  well  as  their  patients.4,5  It  is  described  as  the 
integration  of  provider  experience  with  the  best  external  evidence,  and  takes  into  consideration 
patient  preferences.6,7  The  use  of  EBP  in  nursing  is  a  long-tenn  dynamic  process  which  requires 

o 

devoted  human  and  material  resources,  and  leadership  support.  When  implemented  effectively, 
this  process  includes  systematic,  easy-to-use  methods  to  promote  and  foster  scholarship,  resources 
to  enhance  evaluation  of  evidence  and  implement  projects,  and  continued  follow-up  to  assist 

Oil 

nurses  to  integrating  expertise  into  daily  practice.  '  Yet  to  build  sustain  EBP,  individually  held 
beliefs  and  systemic  organizational  barriers  are  common  across  many  healthcare  organizations 

12  13 

must  be  overcome.  ’ 

In  a  complex  and  often  chaotic  healthcare  system,  nurses  serve  as  the  final  safety  net 
keeping  patients  from  harm;  yet  nursing  remains  a  traditions-based  profession,  rather  than  an 
evidence-based  one.14  Some  assert  that  the  nursing  profession  is  a  culture  unto  itself,  full  of  rituals 
in  practice.15  This  traditional  culture  is  longstanding,  and  is  promulgated  from  generation  to 
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generation  by  nurses’  preferences  in  sustained  practice.  Regardless  of  educational  preparation, 
newly  licensed  nurses  tend  to  emulate  their  preceptors’  practice  patterns.  In  a  tradition-based 
rather  than  an  evidence-based  culture,  nurses  tend  to  follow  outdated  policies  and  procedures 
without  questioning  their  relevance  or  the  evidence  behind  them.  They  continue  to  practice  what 
they  originally  were  taught,  as  opposed  to  integrating  current  research  and  evidence  into  their  day- 
to-day  practice. 

Fineout-Overholt  and  colleagues  suggest  that  workplace  culture  may  be  a  barrier  to  EBP 
as  it  contributes  to  inconsistent  use  of  evidence  among  staff  nurses.16  Melnyk  et  al.  proposed  a 
robust  “culture  of  inquiry”  as  a  precursor  to  the  routine  use  of  evidence  in  daily  nursing  practice.9 
A  culture  of  inquiry  is  one  with  “an  ongoing  curiosity  about  the  best  evidence  to  guide  clinical 
decision  making”  that  provides  the  platform  for  establishing  and  supporting  EBP.9<p49)  Nurses 
who  are  supported  in  a  culture  of  inquiry  are  empowered  to  routinely  ask  questions  and  seek 
answers  about  best  care  delivery.  In  addition,  they  have  the  educational  and  practice  resources 
available  to  provide  EBP. 

Inspiring  cultural  change  has  been  recognized  as  the  key  component  of  propelling  EBP  to 
the  bedside;  however,  organizational  change  is  often  slow  and  can  be  considered  a  barrier  to 
embracing  EBP.  ’  Breaking  this  traditional  paradigm  and  implementing  an  evidence-based 
nursing  culture  takes  encouragement  and  support  at  all  levels  and  in  particular  from  leadership.  In 

turn,  nursing  beliefs  which  are  frequently  cited  to  avoid  EBP  such  regarding  not  enough  time  and 

1 8 

resources  can  influenced. 

While  the  relationship  between  culture  and  the  use  of  evidence  is  rather  intuitive, 
associations  between  education,  knowledge  and  EBP  do  not  seem  to  follow  common  assumptions. 
A  landmark  study  found  that  physician  knowledge  of  current  practice  was  strongly  negatively 
correlated  (r=.54,  p<.001)  with  years  since  graduation.19  This  implies  that  rather  than  increasing 
knowledge  as  experience  is  gained,  physician  knowledge  in  this  study  decreased.  Estabrooks 
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paralleled  this  finding,  positing  that  nurses  rely  on  what  they  learned  in  nursing  school.20 
Considering  that  approximately  70%  of  practicing  nurses  graduated  before  1990,  when  there  was 
less  focus  in  nursing  education  on  using  research,  this  evidence-to-practice  gap  has  continued  to 
widen. 11,21  More  recently,  Pravikoff  and  colleagues  reported  that  among  a  sample  of  1097 
registered  nurses  across  the  United  States,  more  than  half  reported  they  were  not  familiar  with  the 
tenn  EBP,  nor  did  they  believe  their  colleagues  used  evidence  in  practice.  In  that  study,  only  27% 
of  participants  indicated  that  they  had  been  taught  how  to  use  electronic  databases  and  most  did 
not  use  them  to  search  for  evidence.  This  tradition-based  paradigm,  combined  with  an  older  and 
aging  workforce,  a  lengthening  time  since  formal  education,  and  the  ever-increasing  amount  and 
accessibility  of  evidence,  combine  to  make  a  complex  situation  in  which  some  nurses  may  be 
resistant  to  change  and  the  daily  practical  use  of  evidence,  despite  its  breadth  and  availability. 

Nurses  and  organizations  must  be  prepared  and  readied  for  EBP  before  they  can  be 
expected  to  implement  and  sustain  it.  Being  able  to  access  and  find  evidence  is  fundamental  to 
using  it.  Although  there  has  been  a  rapid  emergence  of  accessible  Internet-based  resources  such  as 
MEDLINE,  OVID,  PubMed  and  other  electronic  databases,  evidence  suggests  that  many  bedside 
nurses’  deficiencies  in  computer  literacy  skills  may  be  preventing  them  from  accessing  and  using 
electronic  resources.  At  the  same  time,  remaining  up-to-date  has  become  an  insunnountable 
task;  clinicians  cannot  hope  to  keep  up  with  the  rapidly  expanding  base  of  literature.  The  number 
of  articles  in  biomedical  and  clinical  research  fields  has  more  than  tripled  since  1970,  rising  from 
more  than  200,000  a  year  in  1970  to  more  than  750,000  in  20 10. 22  Further,  nurses  tend  to  read 
professional  journals  that  are  not  research-focused."  In  order  to  stay  relevant  in  practice,  nurses  in 
the  beginning  of  the  21st  Century  would  have  to  have  read  and  critically  reviewed  19  articles  a 
day,  365  days  per  year.7 

In  healthcare  organizations  there  are  barriers  to  EBP,  as  well  as  facilitators  that  contribute 
to  its  promotion  and  use.  Understanding  both  barriers  and  facilitators  is  a  precursor  to 
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successfully  implementing  EBP  into  the  professional  nursing  practice  culture.  Barriers  serve  as 
obstructions  to  the  use  of  evidence  in  daily  practice;  e.g.,  lack  of  time,  absence  of  skill  sets  for 
asking  questions,  deficiency  in  accessing,  searching,  appraising,  and  incorporating  evidence  into 
decision-making.21'23  The  workplace  culture  itself  may  represent  an  under-recognized  yet 
powerful  barrier  to  the  use  of  evidence  in  practice. 1 1  Barriers  also  include  lack  of  systematic  ways 
to  promote  clinical  scholarship,  lack  of  systemic  supports  to  implement  changes,  and  lack  of 
perceived  value  for  research  and  EBP.9’11’24,25  Lack  of  supporting  infrastructure,  including 
leadership,  is  noted  as  a  system-wide  barrier  to  sustainment.  ’  Organizations  may  not  have 
infrastructure  or  processes  in  place  to  support  a  long-term,  systematic  approach  for  developing 
and  evaluating  nursing  interventions,  protocols,  projects,  and  policies  that  are  derived  from 
scientific  evidence.10 

Although  these  and  other  barriers  to  EBP  exist,  there  are  also  factors  that  may  enable 
nurses  to  overcome  EBP  barriers.  EBP  facilitative  factors  include  support  from  mentors  or 
champions,  fonnal  and  informal  education,  reminders  and  prompts,  and  resource  aids.  Mentors 
have  long  been  successful  in  changing  nursing  culture  and  beliefs  through  educating  peers,  and 
can  be  used  in  a  strategy  for  implementing  and  sustaining  a  culture  of  inquiry  in  healthcare 
systems."  Nurses  prefer  to  use  knowledge  gained  through  personal  experience  and  interactions 
with  co-workers  or  with  individual  patients  rather  than  through  journal  articles  or  textbooks;  thus 
developing  unit-level  mentors  may  be  key  to  a  implementing  a  successful  EBP  culture.  ’  In 
addition,  a  number  of  other  interventions  that  facilitate  EBP  adoption  have  been  recommended  in 
the  literature;  e.g.,  learning  from  others  in  a  workshop-type  setting,  and  using  supporting  tools 
that  are  easy  to  reference  and  to  remember.-  ’  ’  However,  educational  offerings  that  focus  on 
didactics  instead  of  hands-on  skills  may  be  ineffective. 1 1 


Evidence-based  Nursing  Practice  in  Military  Settings 
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The  notion  of  using  evidence  to  guide  military  practice  has  existed  since  the  inception  of 
nursing  as  a  profession  in  the  early  18th  century.  Florence  Nightingale’s  seminal  work,  Notes  on 
Nursing:  What  it  is,  What  it  is  not  was  based  on  her  experiences  caring  for  British  Soldiers  during 
the  Crimean  War,  where  she  recognized  through  observation  and  statistical  analysis  that  the 
majority  of  soldiers  who  died  were  not  mortally  injured  by  battle  wounds,  but  died  due  to 
diseases,  infections,  and  other  non-battle-related  conditions.  Furthermore,  Nightingale 
demonstrated  that  informed  nursing  care  could  significantly  reduce  mortality  among  the  wounded. 
Later,  the  call  for  research  as  the  basis  for  EBP  was  recognized  by  Sir  Archibald  Cochrane  while 

-5  1 

serving  as  a  military  surgeon  in  a  WWII  Prisoner  of  War  camp/ 

Modern  military  healthcare  remains  similar  to  that  of  the  civilian  sector  in  its  pursuit  of 
quality,  its  need  to  address  gaps  in  evidence,  and  its  desire  to  apply  best  evidence  to  address 
patient  care  conditions.  The  majority  of  military  medical  threats  today  continue  to  be  non-battle- 
related,  e.g.,  infectious  diseases,  are  frequently  nursing-sensitive,  and  are  found  in  remote  and 

T9 

austere  environments.  ~  Despite  the  rich  history  of  military  nursing  research,  including  the 
establishment  of  the  first  hospital-based  nursing  research  unit  in  1954,  the  uses  of  research  and 
other  evidence  in  daily  clinical  practice  have  not  been  widely  adopted  by  nursing  staff  in  military 
facilities.  ’  The  military  nursing  profession  continues  to  be  called  upon  to  pursue  and  apply 
best  evidence  and  technology  in  response  to  emerging  and  enduring  threats.  Yet  research 
utilization  scores  in  Anny  healthcare  settings  were  found  to  be  significantly  lower  than  those  in 

if 

civilian  settings.  These  shortfalls  in  the  use  of  evidence  persist  despite  increasingly  higher 
educational  levels,  younger  ages  of  nursing  staff,  and  ample  access  to  evidence-based  resources 
among  nurses  who  practice  in  a  military  setting. 

Based  upon  the  authors’  collective  experiences  working  in  the  military  system,  the  tenn 
“evidence-based”  is  commonly  used;  however,  in-depth  understanding  and  commitment  of 
resources  to  support  EBP  is  often  threatened  due  to  rapidly  shifting  and  competing  priorities 
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required  in  a  military  healthcare  system.  Recently,  a  new  practice  model  adopted  by  the  Anny 
Nurse  Corps,  the  Patient  CaringTouch  System  (PCTS),  was  implemented.  The  PCTS  emphasizes 
the  integration  of  EBP  as  foundational  to  providing  competent  care  to  military  beneficiaries.37 
Although  expertise  in  literature  search  techniques,  critical  appraisal  of  evidence,  and  recognition 
of  key  elements  of  the  systematic  review  process  have  been  identified  as  skills  that  nurses  must 
master  in  order  to  become  expert  clinicians,  in  civilian  and  military  nursing  practice  settings  these 

TO 

may  not  be  broadly  supported,  taught,  or  required.  Despite  the  strong  emphasis  on  the  necessity 
for  EBP,  only  a  small  percentage  of  nurses  routinely  apply  evidence  to  their  clinical  practice,  even 
in  civilian  nursing  practice.  ’  Less  is  known  regarding  how  or  whether  nurses  in  military 
settings  have  integrated  and  sustained  evidence  into  their  practice. 

The  primary  purpose  of  this  study  was  to  test  the  effectiveness  of  a  dynamic  EBP 
educational  and  mentoring  program  facilitated  by  unit-level  mentors  to  promote  and  sustain  EBP 
culture  as  prescribed  by  the  Advancing  Research  through  Close  Collaboration  (ARCC)  Model 
(see  Figure  A).40  The  study  created  and  evaluated  a  framework  for  sustaining  the  proposed 
culture  of  inquiry  in  military  hospitals  in  the  Washington,  DC  area  that  were  involved  in  an 
unprecedented  reorganization  mandated  by  the  Congressionally-legislated  Department  of  Defense 
[DoD]  Base  Realignment  and  Closing  [BRAC]  Commission.41  A  secondary  aim  of  this  study  was 
to  detennine  nurse  perceptions  of  a  culture  of  inquiry  in  the  military  hospitals  before  and  after  this 


system-wide  reorganization. 
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Figure  A.  Adapted  version  of  the  Advancing  Research  through  Close  Collaboration  (ARCC) 


model.44  Used  with  permission. 


METHODS 


Design 

This  quasi-experimental  study  utilized  a  pre-post  test  design  to  evaluate  the 
implementation  of  an  EBP  educational  and  mentoring  program  based  on  an  adaptation  of  the 
ARCC  mentorship  model.40  The  local  Institutional  Review  Board  determined  the  study  to  be  an 
educational  program,  and  as  such,  exempt  from  review.  The  ARCC  model  has  been  successfully 
implemented  in  other  academic  medical  centers,  resulting  in  the  development  of  better-prepared 
clinicians  who  applied  EBP  principles  and  created  an  environment  where  changes  improved 
practice  quality,  and  patient  and  staff  satisfaction.42  There  are  four  core  constructs  in  the  ARCC 
model  which  are  to  be  accomplished  in  the  following  order:  1)  organizational  assessment  of 
culture  and  readiness;  2)  identification  of  facilitators  and  barriers;  3)  building  mentors  for 
sustainment;  and  4)  implementation  of  the  program.  The  intervention  tested  in  this  study  targeted 


all  four  constructs. 
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Setting  and  Sample 

At  the  onset  of  the  study,  three  separate  hospitals  supported  military  service  members  and 
other  military  beneficiaries,  in  the  Washington,  DC  area — one  Army  and  one  Navy  medical 
center,  and  one  small  Army  community  hospital.  Prior  to  restructuring,  the  facilities  operated  as 
service  silos,  with  Anny  personnel  working  only  at  the  Anny  facilities  and  Navy  personnel  at  the 
Navy  facility.  The  reorganization  of  these  three  military  medical  facilities  resulted  in  the  creation 
of  several  new  organizations:  a  single,  large  joint  Army,  Navy,  and  Air  Force  medical  center 
system,  with  a  345-bed  inpatient  medical  center;  a  120-bed  community  hospital;  and  several 
outpatient  clinics.  During  the  course  of  the  study  the  hospitals  merged  into  one  common  system, 
with  both  Anny  and  Navy  nurses  working  at  all  three  hospitals.  The  pre-test  data  were  collected 
in  2010,  before  any  unit-level  mentor  interventions  were  implemented,  and  prior  to  the 
institutional  merger.  A  convenience  sample  of  94 1  registered  nurses  (RNs)  and  licensed  practical 
nurses  (LPNs)  from  each  of  the  inpatient  nursing  units  at  the  Army  (19  units)  and  Navy  (13  units) 
medical  centers  were  invited  to  completed  the  pre-test  surveys.  Eighteen  months  later,  post-test 
data  were  collected  from  1053  RNs  and  LPNs  working  on  19  units  at  the  medical  center  and  13 
units  at  the  community  hospital. 

Intervention 

The  study  staff,  which  included  military  nurse  scientists  and  clinical  nurse  specialists  from 
the  original  Anny  and  Navy  facilities,  employed  a  multi-pronged  intervention.  The  primary 
intervention  consisted  of  establishing  a  cadre  of  trained  unit-level  nursing  mentors.  Members  of 
the  cadre  were  identified  and  supported  by  nursing  leadership  to  attend  a  two-day  EBP 
educational  workshop  and  to  serve  as  EBP  mentors.  The  workshop  was  led  by  Drs.  Fineout- 
Overholt  and  Melnyk,  and  facilitated  by  study  staff. 

Nursing  staff  members  from  all  three  facilities  participated  in  the  workshop.  The 
workshop  intervention  activities  and  content  were  modelled  in  response  to  recommendations  in 
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the  literature  for  facilitating  EBP  adoption;  e.g.,  learning  from  others  in  a  workshop-type  setting, 
and  using  supporting  tools  that  are  easy  to  reference  and  to  remember,  with  emphasis  on 
experiential  learning,  i.e.,  demonstrating  hands-on  skills.  ’  ’  Tools  distributed  to  the  nursing 
units  after  the  workshop  also  included  some  of  those  most  highly-recommended  in  the  literature: 
i.e.,  mnemonic  pocket  cards,  and  study  packets  for  independent  learning  and  reinforcement  of 
skills.  ’  This  workshop  targeted  barriers  identified  in  the  literature;  namely  lack  of  knowledge 
and  skills  for  accessing,  assessing,  interpreting,  and  applying  best.11’42  Content  was  organized  and 
presented  based  on  the  5  A’s:  Ask,  Access,  Appraise,  Apply  and  Alert  peers.25'42 

Several  months  after  the  initial  workshop  was  conducted,  the  study  staff  recognized  that 
unit  mentors  required  not  only  continued  mentoring  and  practical  support,  but  further  didactic 
education.  Therefore,  following  the  transition  to  joint  facilities,  several  four-hour  refresher 
workshops  were  conducted  for  the  unit-level  mentors,  along  with  periodic  individualized 
mentorship  sessions  conducted  by  the  study  team.  The  workshop  leaders  reviewed  previous 
content,  targeted  barriers  that  had  been  identified  after  the  transition,  and  coached  how  to  assess 
and  apply  best  evidence  in  the  new  environments. 

In  addition  to  establishing  and  empowering  trained  unit-level  mentors,  the  study  staff  also 
implemented  librarian  support  to  conduct  online  literature  searches  and  retrieve  journal  articles 
and  other  fonns  of  evidence;  distributed  lanyard  hang-tag  style  pocket  cards  and  EBP  textbooks 
to  each  unit;  provided  access  to  individual  self-paced  training  modules;  and  supervised  study 
team  EBP  projects. 

To  serve  as  easy  and  quick  references  to  principles  of  EBP,  pocket  cards  with  the 
mnemonic  CHANGE  on  one  side  were  produced  and  provided  to  workshop  participants. 
CHANGE  stands  for  Challenge  current  practice,  Hunt  for  evidence  in  the  literature,  Appraise  the 
evidence,  Negotiate  a  plan  for  improvement,  Gauge  success,  Establish  policies  for  improved 
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practice.28  The  reverse  side  outlined  How  to  CHANGE  Practice  by  using  EBP,  and  following  the 
“5  As”  (Ask,  Access,  Appraise,  Apply,  and  Alert  peers.25,42  To  further  support  EBP  learning 
activities,  a  self-instruction  module  was  developed  from  workshop  slides;  and  educational 
materials  presented  at  the  EBP  workshops  were  made  available  online,  in  shared  network  folders. 

Instruments 

Four  instruments  were  used  to  evaluate  the  study  intervention:  Organizational  Readiness 
for  System- wide  Integration  of  Evidence-based  Practice  (ORSIEP);  EBP  Beliefs  (EBPB);  and 
EBP  Implementation  (EBPI)  scales;  and  an  investigator-developed  demographic  instrument.43 
Although  three  instruments  (ORSIEP,  EBPB,  and  EBPI)  had  been  previously  validated,  this 
investigation  provided  their  first  testing  at  a  military  medical  facility  43  Face  validity  for  use  in  a 
military  setting  was  reviewed  by  the  instruments’  original  authors  and  the  study  team  members, 
and  was  found  to  be  appropriate  for  use  in  this  population. 

Organizational  Readiness  for  System-wide  Integration  of  Evidence-based  Practice 
(ORSIEP) 

The  ORSIEP  was  used  to  measure  organizational  readiness  for  and  barriers  to  integration 
of  EBP.  This  25-item  survey  uses  a  1-5  Likert  scale  ranging  from  1,  not  at  all  to  5,  very  much. 
Examples  include  “to  what  extent  is  EBP  clearly  described  as  central  to  the  mission  and 
philosophy  of  your  institution?”  and  “To  what  extent  are  the  nurses  with  whom  you  work 
committed  to  EBP?”  Three  items  are  measured  by  percent  quartiles  from  none,  25%,  50%,  75%, 
to  100%,  and  measure  the  extent  of  decisions  that  are  generated  from  “direct  care  providers,  upper 
administrators,  or  physician  and  other  health  care  groups.”  One  item  measures  perception  of 
overall  readiness  of  the  institution  for  EBP  by  “ not  ready,"  to  “ past  ready  and  onto  action .”  The 
last  item  on  this  instrument  measures  respondents’  assessment  of  “compared  to  6  months  ago  how 
much  improvement  in  your  organization  has  there  been  toward  an  EBP  culture?”  on  a  5-point 
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Likert  scale  ranging  from  none  to  a  great  deal.  Individual  scores  were  summed  to  obtain  total 
scores. 


EBP  Beliefs  (EBPB) 

The  EBPB  scale  measured  EBP  beliefs  and  values.  Its  16  items  are  measured  with  a  5- 
point  Likert  scale  ranging  from  1  strongly  disagree  to  5  strongly  agree.  Items  on  this  instrument 
include  belief  and  confidence  statements  such  as  “I  believe  I  can  overcome  barriers  in 
implementing  EBP”  and  “I  am  sure  that  I  can  access  the  best  resources  in  order  to  implement 
EBP.”  The  individual  item  scores  were  summed  for  a  total  score. 

EBP  Implementation  (EBPI) 

The  EBPI  instrument  was  used  to  measure  level  of  EBP  implementation.  It  has  18  items 
in  the  form  of  statements  that  measure  frequency  of  EBP  activities.  Respondents  were  asked  to 
quantify  the  number  of  times  in  the  past  8  weeks  they  had  performed  EBP  activities,  using  such 
statements  as  “I  used  evidence  to  change  my  clinical  practice,”  or  “I  promoted  the  use  of  EBP  to 
my  colleagues.”  Data  were  measured  on  an  ordinal  scale  from  0-4  with  zero  indicating  zero 
times,  1  being  from  1-3  times,  2  from  4-5  times,  3  from  6-7  times,  and  four  indicating  >8  times. 
These  item  scores  were  summed  for  a  total  score. 

Demographics 

A  single  page  of  demographic  questions  captured  the  following  infonnation:  age,  gender, 
military  rank,  and  number  of  years  since  basic  nursing  school  graduation.  In  order  to  match  pre- 
and  post-intervention  data  while  maintaining  anonymity,  respondents  were  asked  to  provide  the 
last  four  digits  of  their  cell  phone  numbers  and  the  year  of  their  birth. 

Data  Collection  and  Analysis 

Paper  surveys  were  distributed  at  baseline  (prior  to  any  intervention),  and  18  months  post¬ 
intervention.  Respondents  took  approximately  1 5  minutes  to  complete  and  deposit  the  surveys 
into  locked,  labelled  survey  collection  boxes  anchored  at  each  unit’s  nurses’  station.  Respondents 
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were  asked  to  use  their  year  of  birth  and  last  4  digits  of  their  cell  phone  number  as  their  code,  so 
that  pre-intervention  surveys  could  be  matched  to  post-intervention  surveys.  To  capture  data  from 
nurses  who  might  have  been  away  or  may  not  have  received  the  first  survey  a  second  survey 
distribution  was  conducted  at  two  weeks  for  both  the  pre-  and  post-intervention  surveys.  Surveys 
and  demographic  pages  were  scanned  into  a  database  using  Teleform®  software  and  hardware. 

Data  were  analyzed  using  IBM  SPSS  for  Windows  (version  22).  Frequencies  were 
obtained  and  examined  for  all  variables.  Descriptive  statistics  were  calculated  for  both 
quantitative  and  categorical  variables.  The  individual  overall  scores  were  computed  for  the 
ORSIEP,  EBPB,  and  EBPI  instruments.  The  dependent  or  paired  samples  t-test  was  performed  to 
evaluate  the  differences  between  and  pre-  and  post-intervention  in  the  matched,  individual  level 
data  (N=56).  Because  the  matched  sample  size  was  relatively  small,  the  total  organizational 
sample  was  also  analyzed  separately,  using  independent  samples  t-tests. 

RESULTS 

The  baseline  survey  response  rate  was  38%  (360/941);  the  post-intervention  survey 
response  rate  was  31%  (325/1053).  Because  of  incomplete  and/or  missing  fields,  6  post¬ 
intervention  surveys  were  removed  from  the  analyses. 

The  demographics  of  both  the  individual/  matched  pair  sample  and  the  organizational 
sample  are  depicted  in  Table  1.  The  56  who  completed  both  the  pre-test  and  the  post-test  were 
slightly  older  than  the  organizational  sample,  but  had  comparable  years  worked  in  nursing.  The 
matched  pair  sample  also  had  a  higher  percentage  of  female  nurses  as  compared  to  the  larger, 
organizational  sample.  Both  samples  had  a  high  proportion  of  BSN-prepared  nurses. 

Table  2  compares  the  pre-test  and  post-test  scores  of  the  matched  individual  sample.  All 
scores  improved  over  time.  The  ORSIEP  and  EBPB  scores  showed  statistically  significant 
improvements  (p  <.05),  but  the  EBPI  scores  did  not.  In  the  organizational  sample,  there  was  also 
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improvement  in  the  scores  from  pre-test  to  post-pest;  however,  only  the  ORSIEP  scale 
demonstrated  a  statistically  significant  improvement  (p  <.05). 

DISCUSSION 

The  primary  purpose  of  this  study  was  to  test  the  effectiveness  of  a  dynamic  EBP 
educational  and  mentoring  program  facilitated  by  unit-level  mentors  to  promote  and  sustain  EBP 
culture  as  prescribed  by  the  ARCC  Model.  The  main  findings,  that  the  scores  of  all  three  scales 
improved,  imply  project  success.  That  two  of  the  three  scales  reached  statistical  significance  in  a 
relatively  small  sample  of  matched  pre-  and  post-tests  is  even  more  striking.  It  is  clear  from  both 
samples  that  organizational  readiness  for  EBP  significantly  improved  following  the  intervention. 

Although  two  thirds  of  the  Anny  nursing  staff  relocated  and  integrated  into  a  Navy-led 
facility,  the  organizational  readiness  scale  demonstrated  unexpected  significant  and  positive 
change  from  pre-  to  post-intervention  among  all  respondents.  Most  nurses  reported  their  belief 
that  EBP  is  central  to  the  organization  mission  and  philosophy,  and  that  EBP  was  practiced  in 
their  organization  before,  and  even  more  so  following  the  facility  integration.  Respondents  also 
frequently  identified  Nurse  Educators  and  Advanced  Practice  Nurses  as  mentors  who  facilitate  or 
support  EBP.  Consistent  with  previous  studies,  and  not  found  to  be  significant  in  this  study,  the 
implementation  scale  results  demonstrated  that  nurses  rarely  used,  discussed,  shared  evidence,  or 
changed  their  practice  based  on  evidence.  Although  not  significant  in  tenns  of  belief,  nurses 
consistently  reported  that  EBP  could  improve  clinical  care  that  apprising  evidence  was  important, 
and  implementation  of  EBP  would  improve  patient  care. 

For  this  study,  the  four  core  ARCC  constructs  were  used:  First  an  organizational 
assessment  of  culture  and  readiness  was  instigated;  second,  the  study  team  reviewed  survey  data 
to  identify  facilitators  and  barriers;  third,  a  cadre  of  unit-level  mentors  was  selected  (with  support 
from  organizational  leaders)  for  education  and  sustainment;  and  fourth,  the  program  was 
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implemented.  There  are  three  important  implications  for  policy  and  practice  from  this  study: 
identifying  and  overcoming  barriers  is  essential;  and  with  this  continued  support  for  EBP,  cultural 
changes  are  possible  even  during  a  chaotic  time  such  as  system  transfonnation. 

At  every  opportunity  the  study  staff  worked  to  integrate  methods  to  barriers  and  provide 
facilitators  to  EBP.  For  example,  as  an  initial  part  of  the  interventional  program  and  as  a  baseline 
of  education  to  ensure  that  all  were  starting  with  the  same  information,  a  two  day  conference  was 
held.  The  workshop  content  included  interactive  discussion  regarding  the  best  recognized  barriers 
to  implementation  and  integration  of  EBP  at  bedside:  absence  of  skill  sets  for  asking  questions; 
deficiency  in  accessing,  searching,  appraising,  and  incorporating  evidence  into  decision-making; 
and  workplace  culture  itself,  which  may  represent  a  powerful  barrier  to  the  use  of  evidence  in 
practice.11  Workshop  leaders  also  emphasized  that  participants  critically  appraise  the  presence  (or 
absence)  in  their  units  of  systematic  ways  to  promote  clinical  scholarship,  lack  of  systemic 
supports  to  implement  changes,  and  lack  of  perceived  value  for  research  and.9,11’24’25 

Study  Limitations 

The  main  limitation  of  this  study  was  the  ongoing  and  unmeasured  change  during  the 
study  period.  Change  was  evident  in  the  turnover  of  staff  due  to  military  moves  and  mission 
requirements;  however,  more  striking  was  the  change  experienced  by  merging  two  very  distinct 
military  cultures  into  a  single  setting.  There  was  no  way  to  capture  whether  this  itself  affected  the 
study  response  rates  or  the  responses  themselves. 

Another  limitation  was  the  small  sample  of  matched  pairs.  In  order  to  use  a  coding  system 
that  would  be  unique,  unidentifiable,  unchanging,  and  easily  remembered  pre-  to  post, 
respondents  were  asked  to  provide  the  last  four  digits  of  their  cell  phone  numbers  combined  with 
their  birth  year.  Many  of  these  codes  were  missing  or  incomplete  on  the  post-implementation 
surveys,  limiting  the  ability  to  match  participants  (matched  n=56).  However,  with  all  the 
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turbulence  of  the  facility  merger,  it  is  possible  that  some  of  the  nurses  who  completed  the  pre-test 
were  no  longer  at  the  facility  and  thus,  could  not  have  completed  a  post-intervention  survey. 

Additionally,  it  would  be  interesting  in  retrospect  to  measure  which  interventions  and 
other  factors,  particularly  those  associated  with  the  facility  restructuring,  influenced  the 
organizational  readiness,  nursing  beliefs,  and  implementation  of  EBP  among  the  nurses.  Future 
effort  may  include  measurement  of  influence  by  mentorship  by  the  newly  established  Doctor  of 
Nursing  Practice  clinicians  in  the  military  healthcare  setting,  with  more  concentrated  training  and 
focus  on  EBP  programs. 

CONCLUSION 

The  results  of  this  study  indicate  that  despite  high  turnover  rates  and  redistribution 
of  nursing  personnel  among  transformed  medical  facilities,  mean  rates  of  commitment  to  essential 
tenets  of  EBP  were  moderately  strong,  are  positively  influenced  by  mentors’  interventions,  and 
remain  moderately  strong  even  after  structural  and  subsequent  team  re-disruptions.  Further 
studies  among  military  nurses,  using  the  same  intervention  and  instruments,  may  show  that 
commonly  perceived  systemic  organizational  barriers  do  not  adversely  affect  -  and  may  even 
raise  -  commitments  to  EBP  organizational  culture,  readiness,  beliefs,  and  implementation. 

Indeed  this  study  does  suggest  that  commitment  to  an  EBP  culture  starts  within  individuals  and 
spreads  throughout  an  organization  one  individual  at  a  time. 

The  skills  necessary  to  find,  evaluate,  incorporate,  and  apply  evidence  at  the  point  of  care 
are  imperative  for  all  health  care  professional  staff.  These  abilities  transcend  military  nursing, 
extending  to  the  larger  medical  community.  In  order  to  accomplish  well-established  and  widely- 
held  goals  regarding  achieving  and  sustaining  best  practices  in  contemporary  health  care,  the 
processes  and  skills  involved  in  evidence-seeking  and  application  must  be  ingrained  as  second 
nature  in  providers.  Conditions,  locations  of  practice,  resources  available,  and  composition  of 
care  teams  may  change,  but  the  process  and  skills  involved  in  seeking  and  applying  evidence  must 
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become  enculturated.  Nursing  must  grow  and  develop  in  a  creative  learning  environment,  with  a 
culture  of  innovation,  evidence-seeking,  and  inquiry.  The  use  of  evidence  at  the  point  of  care  to 
use  best  solutions  to  tackle  patient  care  problems  will  surely  raise  the  level  of  healthcare  quality  in 
the  21st  century. 
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Individual 

Sample 

Organization  Sample 

Quantitative  Variables 

N 

Mean 

SD 

N 

Pre-test 

Mean 

SD 

N 

Post-test 

Mean 

SD 

Age  (Years) 

56 

38.48 

11.33 

302 

37.86 

11.53 

352 

35.86 

11.12 

Years  in  nursing 

56 

10.64 

11.35 

308 

10.72 

10.7 

357 

9.62 

10.1 

Categorical  Variables 

N 

% 

N 

% 

N 

% 

Gender 

Male 

9 

16.1 

92 

28.8 

103 

28.6 

Female 

46 

82.1 

221 

69.3 

255 

70.8 

Nurse  Type 

RN 

51 

98.2 

283 

88.7 

305 

84.7 

LPN/Nursing  Assistant 

5 

1.8 

31 

9.8 

54 

15 

Highest  Degree 

Diploma/Associate 

14 

25 

62 

0.20 

77 

0.22 

Baccalaureate 

39 

69.6 

220 

0.72 

245 

0.70 

Masters/PhD 

2 

3.6 

24 

0.08 

28 

0.08 

Tablel.  Demographics 


Individual  level  scores  (N  = 

56  matched  pairs) 

Pre-test 

Post-test 

Scale 

M 

SD 

M 

SD 

t 

df 

P 

ORSIEP 

53.53 

18.23 

59.3 

16.5 

-1.96 

55 

0.05 

EBPB 

55.12 

12.79 

59.05 

7.98 

-2.38 

55 

0.02 

EBPI 

12.46 

10.98 

14.67 

12.7 

-1.11 

55 

0.27 

Organizational  level  scores 

(N  = 

238  -  347) 

Pre-test 

Post-test 

Scale 

M 

SD 

M 

SD 

t 

df 

P 

ORSIEP 

70.96 

19.9 

77.63 

18.56 

-3.95 

520 

<0.0 

1 

EBPB 

41.12 

8.3 

42.19 

8.7 

-1.59 

644 

0.11 

EBPI 

15.69 

14.29 

17.37 

16.05 

-1.36 

617 

0.17 

Table  2.  EBP  Readiness,  Beliefs,  and  Implementation  Scale  Scores. 


